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Biology achieves novel functions like error correction, ultra-sensitivity and accurate concentration 
measurement at the expense of free energy through Maxwell Demon-like mechanisms. The design 
principles and free energy trade-offs have been studied for a variety of such mechanisms. In this 
review, we emphasize a perspective based on dynamical phases that can explain commonalities 
shared by these mechanisms. Dynamical phases are defined by typical trajectories executed by non¬ 
equilibrium systems in the space of internal states. We find that coexistence of dynamical phases 
can have dramatic consequences for function vs free energy cost trade-offs. Dynamical phases can 
also provide an intuitive picture of the design principles behind such biological Maxwell Demons. 


INTRODUCTION 

Cells constantly sense and process stimuli from the en¬ 
vironment in order to adapt to changing conditions. Un¬ 
covering the mechanisms used by cells for information 
processing and organization is a crucial problem in sys¬ 
tems biology and biophysics. The necessity to dissipate 
energy in order to achieve control or for information pro¬ 
cessing is now well understood!!]. 

A classic example of a dissipative non-equilibrium 
mechanism in biology is kinetic proofreading!^!!]. Ki¬ 
netic proofreading allows crucial biochemical processes, 
such as protein synthesis, to proceed with error rates 
much lower than those implied by equilibrium binding 
affinities. Other prominent biological examples of infor¬ 
mation processing include sensory adaptation and ultra¬ 
sensitive switching - such as those responsible for con¬ 
trolling chemotaxis in E. Coli [5] - which modulate the 
response of the cell to external stimuli. Measurement of 
ligand concentrations by receptors, a problem first stud¬ 
ied by Berg and Purcell, can also be enhanced by the 
consumption of free energy [ET. 

These diverse mechanisms in biology share intriguing 
similarities. All of these mechanisms can be modeled as a 
non-equilibrium driven reaction networks using a master 
equation, 


dtPi = X W APj - W ijPi (!) 

i 

where pi is the occupancy of state i, W is a transition 
matrix and the rates W,y break detailed balance; i.e., 
TI/oop W,;j/Wj ? ; ^ 1 around some loops in the network of 
states [7] . 

In each of the biological mechanisms listed above, we 
desire the sensitivity of the occupancy of a select state (or 
a set of states) O with respect to changes in the kinetic 
parameters W,y to be greatly enhanced (or suppressed in 
the case of adaptation). Hence the biological function of 
these mechanisms can be described using a sensitivity v 


A) Trade-off in models with 
a single dynamical phase 



B) Trade-off in models allowing 
dynamical phase co-existence 



FIG. 1. Dynamical phase coexistence in non-equilibrium 
mechanisms can result in sharp turning points in the trade-off 
curve between function and dissipation. In kinetic proofread¬ 
ing (or error correction), coexistence separates a regime of 
dramatic gains in error correction at a small cost in dissipa¬ 
tion from a regime of small gains at a large cost. Hence phase 
coexistence presents a natural compromise between the two 
incompatible goals of low errors and low dissipation. Simi¬ 
lar considerations might apply to search strategies, accurate 
sensing of concentrations and other active processes. 


of a set of states O, 


= dkg Y,i£oPi 

d\ogX 


( 2 ) 


For example, in proofreading, logA" represents a 
change in W ij due to a change in the energy of an 
enzyme-substrate bound state; in ultra-sensitivity [8], 
adaptation^ and concentration sensing [B] [9, [TD], X 
represents changes in a ligand concentration 0 mHEI- 
In these processes, larger displacement from equilibrium 
(i.e., large detailed-balance breaking) typically leads to 
larger deviations of sensitivity v from its equilibrium 
value mm- 

Thus, in all of these examples, a biologically important 
function — error correction, ultra-sensitive switching or 
sensory adaptation — is enhanced at the expense of free 
energy. The trade-offs between energy dissipation and 
the enhancement of the particular relevant function have 
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been derived for these different systems. Similarly, the 
detailed relationship between the kinetics of reaction net¬ 
works and the enhancement of function have been studied 
for each of these systems. 

Similarities in results across these systems raise nat¬ 
ural questions: Are qualitative aspects of the trade-off 
between energy dissipation and enhancement of function 
intrinsic to the driven non-equilibrium nature of these 
systems? Is there a minimal set of design principles that 
allow biological networks to have prescribed regimes of, 
say, ultra-sensitivity or proofreading ability? Can such 
design principles be formulated in terms of coarse-grained 
aspects of the network architecture? Such abstracted re¬ 
sults are important both for synthetic design and to un¬ 
derstand complex biochemical networks whose detailed 
kinetic constants might never be known. 

In this review, we emphasize a picture based on trajec¬ 
tories that might be useful in answering the above ques¬ 
tions for diverse biological mechanisms. We show that 
the trajectories of non-equilibrium systems in state space 
can be classified as localized or de-localized. We discuss 
how being able to switch between such trajectories al¬ 
lows good function at significantly lower costs. We begin 
by first reviewing work on proofreading that shows all 
these themes; we then review how large deviation theory 
provides useful tools to study dynamical phases in such 
driven systems. Finally, we briefly discuss the relevance 
of these ideas to other systems like stochastic search prob¬ 
lems, sensing of concentrations, ultra-sensitivity and sen¬ 
sory adaptation. 

DYNAMICAL PHASES AND TRADE-OFFS IN 
PROOFREADING 

In the biological context, kinetic proofreading was one 
of the earliest examples of non-equilibrium dynamics pro¬ 
posed to improve an information processing function. 
The original application of proofreading was to the prob¬ 
lem of enzymatic specificity - how can an enzyme strongly 
discriminate between two structurally similar substrates? 
For example, an enzyme E might be able process its 
native ‘right’ substrate R with kinetics W E (defined in 
EqnjTJ); however, E might be able to process an undesir¬ 
able but structurally similar (‘wrong’) substrate W with 
kinetics WjJ' that differ from W- by only a small extent. 
Can such a small difference in kinetics be magnified into a 
large difference in the net rate of the enzymatic reaction? 

For proofreading Ha, this difference in kinetics is usu¬ 
ally due to a difference in the enzyme-substrate binding 
energy. Hence we define a measure of discrimination be¬ 
tween substrates of differing binding energy, 

v{E) = — dlogp(E)/dE (3) 

where p(E) is the occupancy of a final state whose en¬ 
ergy E is a measure of the enzyme-substrate binding en- 


Enzyme E + (Reactants) 
Substrate S (=R or W) 



FIG. 2. Proofreading by a general network can be described 
using three ingredients. 1. A special pathway (reaction coor¬ 
dinate, black), exclusively through which the reaction is com¬ 
pleted, 2. Catastrophes: the enzyme-substrate complex can 
take a discard pathway (blue) off the reaction coordinate and 
rapidly undo the progress made thus far 3. Rescues: instead 
of being reset completely to the reactants state, the system 
may be “rescued” to the reaction coordinate again, resulting 
in only a partial backtrack. Proofreading mechanisms turn 
small differences in the catastrophe (or rescue) rates of differ¬ 
ent substrates into large differences in the reaction completion 
rate. 

ergy and whose occupancy is representative of the rate 
of product formation [2] . 

Hopfield and Ninio[2, ;i4| realized that such discrimina¬ 
tion v is fundamentally limited at thermal equilibrium. 
In fact, at equilibrium, v is constrained to be 1 because 
the occupancy of state p[E) is given by the Boltzmann 
distribution e^ /3E and is completely independent of any 
details of the kinetics. 

Hopfield and Ninio developed a non-equilibrium model 
based on intuition about discard pathways that repeat¬ 
edly disrupt the reaction and allow discrimination to be 
enhanced. Such mechanisms are powered by ATP hy¬ 
drolysis or other equivalent energy source that breaks 
detailed balance[T5j; without such an energy source, dis¬ 
card trajectories are equally likely to be used as pro¬ 
duction pathways and would undo the error correcting 
properties. The idea of discard pathways was general¬ 
ized shortly to allow arbitrarily high discrimination m, 
albeit at a very high cost of ATP turnover. 

Proofreading has been established in protein synthe¬ 
sis by ribosomes, DNA polymerase activity, charging 
of tRNA molecules and argued to play a role in im¬ 
mune receptor EM! , protein synthesis mm, recA 
binding to DNA [23, [MJ and many other biochemical 
processes [251 ES] • Proofreading and biological applica- 
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FIG. 3. Commonly studied proofreading networks with dif¬ 
ferent rescue statistics. (A) Networks with no possibility of 
rescue are commonly used to model immune cell receptors, 
partly because of their simplicity. However, such networks 
can exhibit only one dynamical phase (localized at reactants) 
and hence have poor energy-error trade-offs (Fig. Eh) (B) 
Networks that support rescues throughout the system exhibit 
multiple dynamical phases. The rescue and catastrophe rates 
determine the distribution of backtracking lengths which in 
turn determines whether the system is de-localized, localized 
at reactants or localized at products. Such networks can ex¬ 
hibit the trade-off shown in Fig. ID*- (C) An extreme case of 
networks that favor rescues. The dynamical phases exhibited 
by this network are similar to those of (B); we use this net¬ 
work as a pedagogical example to illustrate calculations of 
dynamical phases. 


netics biased towards taking these pathways. When the 
system takes one of these discard pathways, we call that 
event a ‘catastrophe’ since progress along the reaction 
coordinate has been interrupted. (See Fig. i) 

Rescues : Discard pathways necessarily undo progress 
along the reaction coordinate but they do not have to 
return the system back to the initial state; instead the 
system might be “rescued” to a point along the reaction 
coordinate upstream of the catastrophe, creating only a 
partial reset of the reaction. 

The possibility of rescues, i.e., avoiding complete resets 
after every catastrophe, is central to dynamical phase 
coexistence and the perspective of this review. Hence 
we show three networks with distinct rescue behaviors in 
Fig- HI for purposes of pedagogy and to help understand 
the large body of network models in the literature. 


A) No rescues: The networks of Fig. up not allow 
for any possibility of rescue. All catastrophes take 
the system back to the origin. As argued below, 
these networks cannot support multiple dynamical 
phases and hence have a trade-off curve resembling 
Fig. [i]A. Such models [16lfT9{ I28H32] have attracted 
bulk of the attention, partly owing to early applica¬ 
tions to immunology. It must be emphasized that 
while these models are easiest to analyze, there is 
little experimental evidence to favor these models 
over those with the possibility of rescue. 


tions have been covered in numerous excellent reviews 
(e.g., [U HH |22]). Here, we review only aspects relevant 
to trade-offs and design principles in generic and large 
proofreading networks; thermodynamic effects and the 
existence of non-equilibrium phases are most relevant to 
the behavior of such large networks. 


Design principles and types of proofreading 
networks 

The original proposal of Hopfield/Ninio was based on 
an intuition of discards. Generalizing |12| to arbitrary 
networks without any special structure, proofreading re¬ 
quires the kinetics to favor a class of trajectories that 
bears out this intuition of discards. In a simplified pic¬ 
ture, we assume that one preferred pathway in the net¬ 
work is chosen as the only path through which the reac¬ 
tion is completed; we call this path the reaction coordi¬ 
nate. (In reality, the reaction coordinate might consist 
of multiple allowed pathways, reduced down to a single 
effective coordinate using standard methods E3) 

Catastrophes: Hopfield’s and Ninio’s (suitably gener¬ 
alized) intuition is that this reaction coordinate should 
have many discard pathways branching off it, with ki- 


B) Variable range rescues: We use the ‘ladder’ network 
00112 irn |24| shown in Fig. [3j3 as a stand-in 
for networks which rescue the system after varying 
amounts of backtracking following a catastrophe. 
For the ladder network shown, the length of back¬ 
tracking prior to rescue is distributed exponentially 
from the point of catastrophe. 

C) Short range rescues: An extreme case of networks 
that favor rescues is shown in Fig. HP where each 
catastrophe results in a short-ranged determinis¬ 
tic rescue. While these networks support multi¬ 
ple dynamical phases[32| like those in (B), we use 
such networks as a pedagogical example to quanti¬ 
tatively explore phases in this review. 

Of course, complex networks can contain combinations 
of all three of the above archetypes. With disordered 
networks with varying rates of catastrophes and rescues, 
novel phenomena [34) related to random walks in disor¬ 
dered potentials have been seen [24J but has not been 
fully investigated. For pedagogical reasons, here we fo¬ 
cus on networks like those shown in Fig. 0whose rates of 
catastrophes and rescues do not vary across the network. 
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Trade-offs 


Networks of any kind shown in Fig. [3] can proofread. 
However the trade-off between error and dissipation or 
time cost is determined by the balance of catastrophes 
and rescues. 

The question of trade-offs in proofreading was first 
studied by Bennett [35]; working with small networks, he 
derived equations for the minimum dissipation needed to 
achieve a given error rate. For recent work on trade-offs 
in proofreading (including alternate trade-offs between 
chemical potential and error rate) and related works on 
finite networks, see na m na na- Here, we focus on 
large networks which opens up qualitatively new phe¬ 
nomena related to phase coexistence. 

Since the right and wrong substrate bind to the enzyme 
with slightly different energies, the catastrophe and res¬ 
cue probabilities for the right and wrong substrate differ 
by a small amount. In the simplest model (see Fig. [2]), we 
assume that difference is entirely in the catastrophe rates 
and the kinetic constant d on the discard pathway differs 
for the two substrates. As a result, the probabilities of 
having a catastrophe (i.e., taking the discard pathway) 
at any particular site for the right and wrong substrates 
are given by, 


R d w 
Peat d f 1 


deP E 
de^ E + / 


(4) 


where the binding energy of EW is lower than ER by an 
energy E. 

1. Both substrates localized at reactants. 

The limit of lowest possible error (and associated very 
high costs) is easy to understand and accounts for much 
of the proofreading literature. In this limit, we ignore the 
possibility of rescues (either because the network cannot 
support them or because the rate of rescues is low) and 
assume that catastrophes are very frequent for both sub¬ 
strates (see inset in Fig. [2]), 

/€d< de/ iFj . 


The error rate r/ ~ ( Pw/pr) u goes to its lowest possible 
value, 


rj —>■ e 


—nf3E 


(5) 


where n is the number of discard pathways along the 
reaction coordinate where catastrophes can take place. 
However, the time to complete the reaction with the right 
substrate is exponentially large in n, 

In this limit, both substrates spend their time ‘local¬ 
ized’ near the reactants end of the network since catastro¬ 
phes frequently reset both of their reactions. See Fig. [4jA. 


Hence occupancy ip of states in Fig. [2] decays exponen¬ 
tially from the reactants end of the network even for the 
right substrate. This regime is supported by all the net¬ 
works shown in Fig. [3] 

2. Both substrates localized at products. Alterna¬ 
tively, if discards are unlikely for both substrates, i.e. if 
/ de /3E > d , the catastrophe rates p E at ,P^ a t are very 
small compared to rescue rates. Both substrates, on av¬ 
erage, make linear progress towards the reactants end of 
the network. In fact, the reactions with both substrates 
are now effectively localized at the products end of the 
network (see Fig. |4p) and when reactants are released, 
the reaction is completed quickly. However, while the 
reaction time is greatly reduced to linear in n, the error 
rate is back to the (high) equilibrium level, 

T ~ n,r] ~ e~ ,3E . 

3. Phase coexistence If the reaction network can sup¬ 
port rescues sufficiently (as in Fig. [3] B or C but not A), 
the transition between these two regimes involves a sur¬ 
prisingly favorable regime. When the catastrophe rate 
becomes comparable to the rescue rate, the system exe¬ 
cutes trajectories that are delocalized (see Fig. |4j3) and 
explore the whole network. In fact, as we show in the 
next section, the trajectories are a mix of localized and 
delocalized trajectories and when the catastrophe rate 
matches the rescue rate, we have coexistence between lo¬ 
calized and delocalized trajectories. 

However, the right substrate R has a lower catastrophe 
rate than W (see Eqn. [4]); hence R is closer to being 
localized at the products (regime (2)) while W is closer 
to being localized at the reactants (regime (1)). As a 
result, we find very fast reaction completion times for R 
while still greatly suppressing the reaction rate for W, 

T ~ n, v ~ e.~ npE ' 

where 0 < E' < E. Hence at coexistence, we find a 
enormous speed-up of the reaction at only a small cost 
in error rate, (shown as the natural compromise point in 
Fig.0B). 

Intuitively, we find that the two substrates can be lo¬ 
calized at different ends despite having a small difference 
in kinetics. Note that at phase coexistence, we do pay 
a price in the form of large variance in reaction comple¬ 
tion times for the right substrate. However, the mean 
completion time near phase coexistence is significantly 
lower than in the regime with lowest error (i.e., when 
both substrates are localized at reactants). 

In this perspective on proofreading, we are using the 
delocalized phase as an inevitable intermediate in order 
to switch quickly from one localized phase to another. 
In other systems, being able to switch easily from local¬ 
ized to the delocalized phase itself might have function 
consequences. 
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FIG. 4. Typical trajectories in a dynamical phase are deter¬ 
mined by the balance of catastrophe and rescue rates. (A,C) 
If either the catastrophe or rescue rate is much higher than 
the other, the system is localized at one end of the network. 
The state occupancy decays exponentially away from the lo¬ 
calization site. Typical trajectories involve small cycles pass¬ 
ing through such a site. (B) If catastrophe and rescue rates 
are comparable, the system is de-localized and explores the 
whole network. (D) If substrates R and W are both localized 
at the reactants or products end of the network, we find min¬ 
imal error but at very high cost or vice-versa. Instead, near 
the co-existence point, we find much reduced dissipation and 
only a small increase in error rate (natural compromise point 
of Fig. |TjT) . In this regime, the small difference in catastrophe 
rates for R and W leads to dramatically different behavior for 
the two substrates; R is (nearly) localized at products while 
W is (nearly) localized at reactants. 


LOCALIZED AND DELOCALIZED PHASES. 


The calculations presented in the previous section 
demonstrate that simple models of kinetic proofreading 
and microtubule growth dynamics exhibit multiple dy¬ 
namical regimes [24] . The transition between regimes is 
sharp and has a thermodynamic quality. The language of 
large deviation theory m can be used to formally under¬ 
stand the transition between different kinetic regimes and 


to anticipate ways in which the transition can be gener¬ 
alized. Indeed, dynamic heterogeneity and intermittency 
have been observed in many other biophysical systems 
including the dynamics of kinetic proofreading by RNA 
polymerase on nr RNA strands [38], and the dynamics of 
gene regulatory networks HTOl . 

We begin by reviewing some simple models of non equi¬ 
librium dynamics [33]. The strategy adopted in these 
studies revolves around computing the cumulant gener¬ 
ating functions and the large deviation functions for en¬ 
tropy production in these networks m- From these cal¬ 
culations it is apparent that the trajectories produced 
in these simple models can be separated into two classes: 
one class of trajectories is delocalized throughout the net¬ 
work, and a second class is localized around a few points 
in the network. These classes of trajectories are sepa¬ 
rated by a dynamical phase transition. The calculations 
show that a class of non equilibrium systems can, under 
very general conditions, support two different dynamical 
modes. Similar inferences can be drawn by considering 
the statistics of other path dependent observables such 
as first passage times. 


Large deviation theory and importance sampling in 
trajectory space 

The probabily of observing a particular value of en¬ 
tropy production, w, in a trajectory of length r 1 
obeys a large deviation principle [40J . 

P(w) » (6) 

where a = lo/t is the entropy production rate, and 1(a) 
is the large deviation rate function. The large deviation 
rate function 1(a) can be determined from direct sim¬ 
ulation of P(uj), though large deviations are difficult to 
sample as r grows. Alternatively the convex envelope 
of 1(a) can be computed as the Legendre transform of 
the scaled cumulant generating function ip u (X) @3 I3D] 

ezi na, 

V’w(A) = lim -ln(e _A “), (7) 

r—>oo T 

where the expectation value is taken over trajectories ini¬ 
tialized in the steady state distribution. 

Following the general framework laid out by Lebowitz 
and Spohn [3D], the cumulant generating function ip u ( A) 
can be computed as the maximum eigenvalue of a matrix 
operator, W w (A), which is simply related to W, the tran¬ 
sition matrix for the kinetic network [40]. Specifically the 
ij matrix element is given by 

w u (X)ij = (1 - Sij) W A W}" A + SijWy. (8) 

By solving for the eigenspectrum of W^(A) the cumu¬ 
lant generating function ip w (X) and therefore the large 
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deviation function 1(a) can be computed via a Legen¬ 
dre transformation. We also note that the fluctuation 
theorem implies a symmetry in the scaled cumulant gen¬ 
erating function, tp ul (X) = ip u (l — X) pfOl . 

The eigenvectors of W w (A) also hold special signifi¬ 
cance mm ■ They reflect the character of the dom¬ 
inant trajectories in an ensemble in which trajectories 
have been importance sampled [43] according to the bias 
exp(—Aw) where w is the entropy produced along the tra¬ 
jectory. Indeed, when A = 0, the biasing function is unity 
and left eigenvector of the W w (A) is simply proportional 
to the steady state probabilities. 

Discontinuities in the first derivative in the cumu¬ 
lant generating function signal the presence of dynam¬ 
ically heterogeneity and intermittency in the dynamics. 
Specifically, a discontinuity in the cumulant generating 
function implies the presence of two dynamic phases. 
The corresponding large deviation rate function has a 
tie line connecting average entropy production rate of 
the two phases [33 EH]. Dynamical phases in glassy 
materials. HTj. protein folding dynamics [15], and models 
of driven systems [IB] have been discovered using such 
approaches. 

Dynamical heterogeneity in biochemical networks 

A natural question is whether the formalism of large 
deviation theory and statistical mechanics in the space 
of trajectories can be used to understand the presence 
of multiple classes of trajectories in kinetic proofread¬ 
ing and microtubule growth models. Indeed, analysis of 
the cumulant generating functions for first passage times 
(and other observables that reflect the transport proper¬ 
ties of trajectories) have yielded fruitful results in models 
of kinetic proofreading [24] . 

Consider the network shown in Fig. [5] It consists of 
triangular motifs which are replicated around in a chain. 
The symmetry is broken with a /i-link (see Fig. [5]). Each 
triangular motif asymmetric links that ensures cycling 
currents on average. This system of connected triangu¬ 
lar motifs is similar to the kinetic proofreading network 
in Fig. [3] (C). Each triangle segment can be thought of 
as offering two different pathways, one of which is catas¬ 
trophe followed by an immediate rescue, to go between 
two states. The h link in this network mimics the rate at 
which the polymerase enzyme cycles through the proof¬ 
reading process. When used as a model of kinetic proof¬ 
reading, the asymmetry in the rates can either be due to 
energetic or kinetic considerations [13] , 

The cumulant generating functions and the large devi¬ 
ation functions for this simple network reveal interesting 
features. Analysis of the large deviation function reveals 
contributions from two classes of trajectories. One class 
of trajectories is delocalized throughout the entire net¬ 
work. The second rare class of trajectories is localized 


h 



FIG. 5. A network similar to one the depicted in Fig. @(C) 
with short ranged rescues and catastrophes. The h link con¬ 
nects up the ends of the network and is mean to model the 
rates associated with the cycling between the reactant and 
product states. 


Transfer matrix B 



FIG. 6. The largest eigenvalue and eigenvector of the titled 
matrix, Eq.[8]are computed by expressing the eigenvalue prob¬ 
lem W„(A )fi = ip u (X)fi using transfer matrices. For elements 
that are not adjacent the heterogenous link, a transfer matrix 
B connects elements of the eigenvector inside the shaded circle 
to elements of the eigenvector inside the open circle. Similar 
transfer matrices, Ai and A 2 are defined for elements adjacent 
and spanning the heterogeneous link. 

near heterogenous link (Fig. [7|. The delocalized trajec¬ 
tories consume energy at a higher rate. Indeed, numerical 
simulations reveal that the cumulant generating function 
exhibits a cups or a singularity in the slope at particu¬ 
lar values of A (Fig. [8]). These cusps signal a dynamical 
phase transition. 

To clarify the nature of these phases we review the 
calculation of the cumulant generating function. First, 
consider a network in which N triangular motif are con¬ 
nected together in a ring configuration. This network 
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has translational symmetry. The tilted matrix of the 
translationally symmetric variant of the triangle network 
(Fig.§ , W£f(A), can be diagonalized by a discrete Fourier 
transform. The largest eigenvalue of this matrix, or the 
scaled cumulant generating function A), is smooth. 

The rate function resulting from the Legendre transform 
of V>£f(A) is a simple convex function peaked around the 
average entropy production rate. With no broken sym¬ 
metry there is only one dynamical state. 

Networks with the h link support a second phase. The 
cumulant generating function for the function with the 
h link can be computed using a novel perturbation the¬ 
ory. We review this approach below. Let /,; denote the 
elements of the right eigenvector corresponding to the 
largest eigenvalue of W w (A). The eigenvalue problem 
W w (A)/j = "00,(A) can be recast in terms of transfer ma¬ 
trices [33]|47|. Specifically, a transfer matrix B[ip u ( A)] 
can be constructed such that it maps certain elements of 
the eigenvector inside the shaded circle in Fig. [ 6 ] to the 
elements inside open circle. This transfer matrix acts 
on elements away from the heterogenous link. Similar 
transfer matrices A\ and A 2 can be constructed across 
the heterogenous link. Using the notation /,;, A+i to 
denote the collection of elements inside the shaded and 
the open circle respectively in Fig. [Gj and performing the 
transfer matrix operation around the ring, the eigenvalue 
problem can be recast into 

A = B N ~ 2 A 2 A 1 f 1 (9) 

The eigenvalues of (A), in particular the largest eigen¬ 
value Vbj(A), have to satisfy Eq. which requires that 
that the matrix B n ~ 2 A 2 Ai have an eigenvalue 1. The 
corresponding eigenvector can be used to obtain the ele¬ 
ments of the largest eigenvector. 

The eigenvalue problem in Eq. [9] cannot be immedi¬ 
ately solved since the transfer matrices themselves de¬ 
pend on the cumulant generating function 0 W (A) 85] . 
Fortunately, in the large N limit, the system with the 
/i-link can be analytically solved using a perturbation 
theory around the solution of the fully periodic network. 
Specifically, the following perturbation ansatz can be pro¬ 
posed. 


0u(A) 





( 10 ) 


ln(P(o)) 


FIG. 7. The probability distribution associated with observ¬ 
ing an entropy production rate a in the network. The proba¬ 
bility distribution of the network with the heterogenous link 
has a second rare phase which produces entropy at a lower 
rate a*. The probability distribution is localized around the 
heterogeneity when the system is in this dynamical this phase. 
By comparison, the probability distribution of the symmetric 
network has a single dynamical phase producing entropy at a 
rate a £ 


1 Network with heterogenous link 
» Symmetric network ^ - ' / 


Rare phase: 
low entropy 
production 
rate 


When A < A*, the components of the eigenvector, /„, 
resemble those of the translationally symmetric network 
and have a predominantly delocalized character, In f n ~ 
n/N. Entropy is dissipated as the system goes through 
global cycles in the delocalized state. 

When 7 diverges as A —> A*, the translationally sym¬ 
metric network no longer offers a good perturbation ba¬ 
sis. Rather, the eigenvectors are now localized around the 
inhomogeneity of the network I 11 f n ~ — an. The compe¬ 
tition between the rescue/catastrophes and the hetero¬ 
geneities in the network couple to stabilize a localized 
mode. Entropy is generated by current fluxes in local 
cycles around the heterogeneity. The entropy generation 
rate in the localized and delocalized phases are markedly 
different. In the setup reviewed here, the delocalized 
phase consumes energy at a higher rate as the system 
cycles the entire network. 

The relative fractions of localized and delocalized 
phases is related to the location of the kink, A*. Specifi¬ 
cally, the slope of the tie line in the large deviation rate 
function connecting the entropy generation rates charac¬ 
teristic of the localized and delocalized phases is equal to 
A*, 


The equation Eq. (10 1 provides a perturbative solution 
to the aperiodic system. The perturbation theory is self 
consistent and breaks down when the vale of 7 diverges. 
This breakdown happens as A approaches a particular 
value A*. For A > A*, the perturbative approach is not 
valid. Thus, in the large N limit, the broken symme¬ 
try network behaves exactly like the periodic network up 
to that value A*, at which point it deviates markedly 
(Fig.§. 


a* = (/K)-AA))/K-^D, (11) 

where a j* is the entropy generation rate characteristic of 
the delocalized phase and cr* is the entropy generation 
rate characteristic of the localized phase. The localized 
and delocalized phases coexist when kinetic constants are 
chosen so that A* = 0. 

The transfer matrix framework reviewed here is appli¬ 
cable more generally. Indeed, we note that similar trans¬ 
fer matrix techniques have been used to study single par- 






tide localization in strips of disordered media T7]. This 
analogy suggests that localized and delocalized phases 
should be present in a larger class of biochemical net¬ 
works including for example the network with finite range 
rescues and catastrophes as described in Fig. 1(B). 

While the networks reviewed here support the delocal¬ 
ized phase in its steady state —the localized state oc¬ 
curs in a rare sub ensemble of trajectories —kinetic rates 
can also be constructed so that system is localized in the 
steady state. The localized subclass of trajectories can be 
made more likely by sampling trajectories according to 
the biasing function exp (—Aw). Applying a bias equal to 
exp(—A*w) makes the likelihood of the two phases equal. 
Further, using the Doob h-transform BU> it is in fact 
possible to construct Markov processes that generate en¬ 
sembles equivalent to the ensemble of trajectories gener¬ 
ated through the application of biasing techniques. This 
framework allows for the design of networks which can be 
tuned to support both localized and delocalized regimes. 



-0.4 o.o 0.4 
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FIG. 8. The cumulant generating function for the triangle 
network in Fig. [5] for a particular set of rates (Solid line) has 
a kink or a discontinuity in its first derivative. In comparison, 
the cumulant generating function of translationally symmetric 
variant (dotted line) has no such singularity. The slope of the 
cumulant generating function is related to the rate of entropy 
production. 

The existence of multiple dynamical phases implies 
that such kinetic networks can be tuned to serve differ¬ 
ent purposes. Networks in their localized state illustrate 
how non equilibrium dynamics can be used to achieve 
control the system mainly samples states near the h- 
link — at the cost of energy dissipation. Indeed, as noted 
previously networks similar to that in Fig. [5] are used in 
modes of kinetic proofreading |12] to achieve discrimina¬ 
tion between two macromolecular states. Moreover, the 
analytical framework described above can be used to esti¬ 
mate the energy requirements (measured for example by 
the rate of entropy dissipation) in these and other simi¬ 
lar feedback and control processes m The steady state 
of the network can either be localized near the states 1 


Food 



FIG. 9. Search for ‘Food’ through a weakly biased random 
walk can be greatly enhanced by adopting trajectories with 
“dynamic instability”. If such trajectories are posed close to 
the localization-delocalization transition, small differences in 
catastrophe rate in different parts of space will have magnified 
consequences on large scale motion; motion can be rapid in 
the direction of ‘Food’ while still highly suppressed in other 
directions. Microtubules are thought to face such a search 
problem when locating centromeres during spindle formation; 
dynamic instability of microtubules, if tuned to coexistence 
of bounded and unbounded growth can greatly speed up such 
a search. 

or near the state N depending on kinetic constants in 
the network. The two localized edge states map onto the 
bound and unbound modes in the context of microtubule 
growth, and to localized modes at the reactants or prod¬ 
ucts in the context of kinetic proofreading (Fig. |3](C)) 

The transition between these two states is sharp when 
JV > 1. A network poised localized near the reac¬ 
tant nodes but poised close to a dynamical phase tran¬ 
sition can be particularly effective for kinetic proofread¬ 
ing. Such a network will have a high throughput due 
to its ability to utilize the high transport properties of 
the de-localized state. The trade-off between error rates 
and throughput rates can hence be optimized by tuning 
a system close to a dynamic transition. As discussed be¬ 
low, for microtubule growth, the dynamics close to phase 
transition point provides an optimal search strategy. 

IMPLICATIONS FOR OTHER BIOPHYSICAL 
PROCESSES: OPEN QUESTIONS AND FUTURE 
DIRECTIONS 

Search problems in weak gradients 

The trajectory picture emphasized in this review also 
suggests new search strategies in uncertain environments. 
Adding an active non-equilibrium component to ran¬ 
dom walker’s exploration statistics and tuning this non¬ 
equilibrium component to coexistence between localized 
and delocalized trajectories can greatly reduce the time 
to find a target. 
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Consider a random walker that leaves the ‘Home state 
(see Fig. [9]) and executes a random walk with fixed step 
size that is weakly biased towards a target (‘Food’). (We 
denote this fixed small bias e^ A to connect to proofread¬ 
ing.) Such equilibrium exploration of the environment 
will result in a long time to find the food source, espe¬ 
cially when ‘Food’ is far relative to the step size of the 
random walker and the bias is small. 

Instead, consider “active exploration”: after the ran¬ 
dom walker has randomly decided to take a step back¬ 
wards, the walker can randomly decide to make the size 
of the backward motion large compared to the usual step 
size. Such a large step is allowed to reverse a finite frac¬ 
tion of the displacement from ‘Home’. The initiation and 
termination of such a reversal are analogous to catas¬ 
trophes and rescues discussed earlier in the context of 
proofreading; in particular, the length of such reversals 
is related to the balance of catastrophe and rescue rates. 

“Active exploration” can be thought of as exploration 
with alternate statistics of returns ‘Home’ but with 
no greater intrinsic bias towards ‘Food’. Nevertheless, 
search is greatly enhanced by tuning the active com¬ 
ponent of the exploration statistics to the localization- 
delocalization transition. 

In such a regime, even if the bias is weak and the varia¬ 
tions in catastrophe rates in space is small, the net effect 
of such a change on large scale motion can be dramatic. 
Trajectories that head in the wrong direction have catas¬ 
trophic reversals at a rate that is just high enough to 
localize the walker at ‘Home’. On the other hand, trajec¬ 
tories in the right direction might begin similarly biased 
towards ‘Home’ but have a falling catastrophe rate as 
they proceeds towards ‘Food’. Once the catastrophe rate 
falls below a threshold, the walker moves rapidly forward 
and finds the ‘Food’. ‘Food’ is effectively brought closer 
to the walker, positioned at a point where the catastro¬ 
phe rate falls below a threshold. 

Microtubules are thought to face a similar problem in 
the search for chromosomes (or centromeres) during mi¬ 
totic spindle assembly [48] [49]. The framework of dynam¬ 
ical phase coexistence emphasized in this review suggests 
that the search for chromosomes is greatly sped up when 
microtubule growth is posed close to phase coexistence 
between ‘bounded’ and ‘unbounded’ growth, i.e., when 
the rate of catastrophes is comparable to the rate of res¬ 
cues. In this limit, even a weak gradient of molecules that 
can modulate the catastrophe rate can have a dramatic 
impact on large scale motions. Evidence for such molecu¬ 
lar mechanisms that can modulate catastrophe rates has 
emerged in recent years 1501- 


Other ways of encoding substrate differences 

Within the context of proofreading, recent work m 
nn has classified proofreading schemes by whether the 


difference between right and wrong substrates is encoded 
in differing binding energies (as in the original papers 
M) or in the heights of activation barriers (as in sub¬ 
sequent work by Bennett [55] ). The latter models can be 
described by Eqn. [3] if binding energy E is replaced by 
the height of an activation barrier in the network. While 
small networks have been studied by [33], the response of 
large generic networks to changes in activation barriers 
remains unexplored. Many biochemical systems might 
well rely on such discrimination coded in activation bar¬ 
riers [52] , 




L Signalling states 
Non Signalling 
ft Signalling 




FIG. 10. Schematic of the network [53] used to model a signal¬ 
ing receptor that measures the concentration of an external 
ligand. Ligand binding promotes occupancy of the signal¬ 
ing states and ligand concentration is read out as the time 
T a spent in such signaling states. The receptor can measure 
concentrations accurately by expending free energy (e.g., cou¬ 
pling ATP hydrolysis along the ring shown) and reducing the 
variance of r a . A particularly favorable regime of highly en¬ 
hanced accuracy at a small free energy cost (in the sense of 
Fig. [Tj3) might be obtained by tuning the network at coexis¬ 
tence between localized and delocalized phases. 


Thermodynamics of concentration measurements 

Exploring the tradeoffs between entropy consumption 
and the ability of a biochemical apparatus to sense con¬ 
centrations has been a topic of recent interest m [ 53 ]- 
[55] . A recent paper by Lang et al [53] puts forward a 
general phenomenological model (Fig. [To]) to understand 
the tradeoffs between concentration sensing and entropy 
consumption. The model system is composed of a non 
signaling chemical state coupled to an array of signaling 
states. The rates for transition between signaling and 
non signaling states depends on the concentration of the 
ligand. The transition from the non signaling state to 
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the signaling states is driven by ligand binding events. 
For constant rates k cw and k ccw for transitions between 
the signaling states, the network in Fig [To] (and its gener¬ 
alizations with additional signaling states) qualitatively 
supports the same dynamical phases described in the pre¬ 
vious sections [S3] ■ The transition rates between the non¬ 
signaling and the signaling links play the role of the het¬ 
erogeneity or the h link. 

The concentration of the ligand can be inferred from 
measurements of the time spent by the system in the 
signaling states. The uncertainty in the concentration 
measured has been worked out to be [53 


(M!> 

c2 


1 

N 


((Sr s ) 2 ) ' 

^2 


( 12 ) 


where N is the number of ligand binding events, f s is 
the mean time spent in the signaling state after binding 
a ligand and (( 5t s ) 2 ) is the variance of the time spent in 
the signaling states. 

Can the variance of the time spent in the signaling 
states, and hence the uncertainty, be reduced at the 
cost of energy consumption? Lang et al (53] find this 
to be case. In fact, they find a trade-off curve resem¬ 
bling Fig. where a large reduction in uncertainty can 
obtained at a small energy cost followed by a regime of 
small further reductions in uncertainty at a large energy 
cost. This analogy suggests that tradeoffs similar to those 
discussed here for kinetic proofreading and search strate¬ 
gies might be accessible to signaling networks. A sig¬ 
naling network at the cusp of dynamic phase transition 
can remain localized near the non signaling states in the 
absence of any ligand binding events. A minor perturba¬ 
tion, such as a ligand binding event, can induce the sys¬ 
tem to undergo a transition to the delocalized signaling 
state. The trade-off between reliability of the concentra¬ 
tion readout and entropy consumption might be optimal 
closer to such a coexistence point. 

Additional support for the unifying theme of dynam¬ 
ical phases comes from recent work on variable sen¬ 
sitivity and programmability of concentration sensing 
[a m]. no found that the sensitivity to concentrations 
can be modulated, closely paralleling variable proofread¬ 
ing regimes found in [12] ■ The parallels extend to ‘anti¬ 
proofreading regimes of m where the response to chang¬ 
ing binding energies (or ligand binding in m) is re¬ 
duced as compared to equilibrium. In [T2], some of these 
‘anti-proofreading regimes were interpreted in terms of 
modular sub-networks which can in turn be interpreted 
as designer phase coexistence. The general relationship 
between modular design of non-equilibrium mechanisms 
and dynamical phases deserves further study. 


Possible implications for ultra sensitivity 


Non-equilibrium driving forces also play important 
roles in sensory adaptation [13] and ultra sensitivity [8]. 
The framework of localized and de-localized phases might 
indeed apply to these other processes. The localized 
phases can be a generic route used by biochemical sys¬ 
tems to reinforce information encoded in the equilibrium 
landscape. 

Consider for instance ultra sensitive switches la mi 
found in E. coli chemotaxis and other biochemical sig¬ 
naling motifs. Existing modeling approaches rely on an 
equilibrium allosteric framework. However, recent exper¬ 
imental 153(55] and theoretical results 0 suggest that 
non-equilibrium forces might play a crucial role in ultra 
sensitive switches The landscape imposed by the equilib¬ 
rium allosteric interactions can be reinforced with non 
equilibrium fluxes in a localized phase. Further an ultra 
sensitive switch positioned at the cusp of a dynamic phase 
transition can fruitfully utilize non equilibrium driving 
forces to rapidly go between different dynamical regimes. 
Indeed, the enhanced fluctuations in the ultra sensitive 
E. Coli flagella motor as it switches from the clockwise 
rotational mode to the counter clockwise rotation mode is 
reminiscent of a delocalized state. It will be interesting 
to study well characterized ultra sensitive systems and 
investigate whether dynamical phase transitions serve as 
an important organizing principle. 
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